Markerless Facial Motion Capture

نویسندگان

  • Sara J. Saito
  • Sara Jessica Saito
چکیده

With the ever-rising capabilities of motion capture systems; this project explored markerless facial motion capture programs using the Kinect Sensor for Xbox. Many systems today still use markers and end up retargeting after a motion capture recording. This project used a simpler process of setting up and being able to display the effects live. An off-the-shelf system was built using a computer, a Kinect Sensor, a plug-in from Brekel, and Autodesk software. The first goal was to create a process that was able to capture and project live facial motion for fewer than $500 USD. Anything over $500 USD was considered to be more of a professional studio setup. With an inexpensive setup, amateur users can do motion capture outside of a studio. The second goal was to observe the outcome of the audiences' responses and see if interaction felt more mechanical than human. ii ACKNOWLEDGMENTS There are so many people to thank, people that played a vital part to my project. First of all, the creators/companies of the various programs and hardware used for this project: Microsoft, Autodesk, and Jasper Brekelmans. Without one of those, I believe my goal would not succeed as it did. Jasper especially helped by guiding me on his creation, the Brekel plug-in. Athough far away in Amsterdam, his forum posts were timely responses to my questions. My chair, Professor Perkins-Buzo, was equally informative about my study. He was always there to help troubleshoot any problems that occurred and help guide my creative ideas into one particular path. I'd like to thank have such friends to support me and see my system in action. I am especially grateful to my significant other, Jordan Devenport. He saw me spend many late nights working on solving various problems and his encouragement helped keep me going. Finally, I am thankful for my parents. Although they don't quite understand my study, their support has added an extra cushion of comfort to my schooling.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Humaface : Human to Machine Facial Animation

This project aims to review existing approaches to animate in real time the facial features of a virtual character. We investigate a tool that will be usable for artists in live performances or to facilitate the creation of animation movies thanks to a quick preview of the results. The animation data are obtained by facial motion capture instrumentation (marker-based or markerless) or are gener...

متن کامل

Facial animation retargeting framework using radial basis functions

In this paper we demonstrate our framework of facial motion retargeting. We define pairs of source and target expressions and their variable configurations. For a given new source expression the target variables are automatically adjusted accordingly. We use Radial Basis Function (RBF) based regression methods to define the relationship between source and target configurations. We also investig...

متن کامل

Feasibility of a single camera markerless motion capture system to accurately measure flexion-extension

INTRODUCTION Traditional motion capture techniques use markers to measure movement. However, markers are prone to soft tissue artifact and experimental error [1] as well as possible impedance to natural motion. Another significant challenge is the ability to use optical motion capture systems in a variety of natural setting such as a patient’s home, on the sports field, or in public. This has l...

متن کامل

Animation of 3D Human Model Using Markerless Motion Capture Applied To Sports

Markerless motion capture is an active research in 3D virtualization. In proposed work we presented a system for markerless motion capture for 3D human character animation, paper presents a survey on motion and skeleton tracking techniques which are developed or are under development. The paper proposed a method to transform the motion of a performer to a 3D human character (model), the 3D huma...

متن کامل

A Critical and Comparative Analysis on Real-World Applications

In this paper we provide the reader with a simple, yet thorough, overview of what is motion capture, its history and evolution so far and processes used in acquiring the tri-dimensional data of the recorded scene, take or animation. A brief look at the “mocap” process’s (short for motion capture) structure is given followed by an extensive list of the technologies behind the most popular system...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2015